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1.  Summary  Of  Research 


1.1  Statement  of  the  problems  studied. 


In  this  research  project  we  have  established  several  landmark  results  in  large  deviation 
theory,  invariant  properties  of  common  statistical  tests,  Bahadur  efficiency  computations 
and  the  study  of  standby  redimdant  systems.  These  results  have  numerous  applications 
to  Statistical  methodology,  Monte  carlo  simulations,  bootstrap  methods  and  Bayesian 
statistics  and  in  the  study  of  reliability  of  systems.  In  the  next  four  sections  below  we 
outline  briefly  the  technical  details  of  significant  accomplishments  of  the  work  done  under 
this  contract. 

1.2  Summary  of  the  most  important  results. 

1.2.1  Large  deviation  theory. 


Let  be  a  Polish  space,  that  is,  a  complete  separable  metric  space  and  B  be  the  Borel 
CT-field  on  f2  containing  all  the  open  and  closed  subsets  of  fi.  A  function  /(r)  :  fl  — ^  [0,  oo] 
is  said  to  be  a  rate  function  if  it  is  lower  semi-continuous.  Let  be  a  sequence  of 

probability  measures  on  (fi,  B).  We  say  that  obeys  large  deviation  principle  (LDP) 
with  rate  ftmction  I{x)  if  the  following  conditions  are  satisfied: 

(1)  limsup -log  ^„(C')  < -/(C) 

n  IT 

(2)  liminf  —log  Pn{G)  >  —I{G) 

n  n 

for  all  closed  sets  C  and  for  all  open  sets  G  of  D.  The  rate  function  I{x)  is  known  as  a 
proper  rate  function  if  for  each  L  ^  0,  the  level  set  {r  :  I{x)  <  L}  is  a  compact  subset  of 
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fi.  Note  that  proper  rate  functions  axe  also  rate  functions,  since  a  nonnegative  function 
is  lower  semi-continuous  if  and  only  if  the  level  sets  are  closed. 

Let  (fli,  Bi),  (n2j  ^2)  be  two  Polish  spaces  with  their  associated  Borel  <T-fields.  Let 
{^i„}  be  a  sequence  of  probability  measures  on  (Oi,  Bi)  and  {t'„(xi,  B2)}  be  a  sequence 
of  transition  fimctions  on  Cli  x  82-  Consider  a  sequence  of  probability  measures  {/z„}  on 
the  product  space  (fi,  B)  =  (fli  x  ^2,  ®  B2)  given  by 

X  62)=  I  B2)dfiin{xi) 

for  Bi  ^  Bi,  i  =  1,  2. 

We  say  that  the  sequence  of  probability  transition  functions  •),  Xi  €  L5i}  sat¬ 

isfies  the  LDP  continuously  in  x\  with  rate  function  J{x\,  X2),  or  simply  LDP  continuity 
condition  holds,  if 

(i)  For  each  xi  €  fii,  J{xi,  •)  is  a  proper  rate  function  on  D2- 

(ii)  For  any  sequence  {a:i„}  in  such  that  a;i„  —>■  xi,  the  sequence  of  measures 

’)}  ^2  obeys  the  LDP  with  rate  function  J(xi,  ■),  and 

(iii)  J(xi,X2)  is  jointly  lower  semi-continuous  in  (xi,X2). 


Suppose  that  the  sequence  {/^in}  obeys  the  LDP  with  proper  rate  function  /i(xi) 
and  the  sequence  of  probability  transition  functions  {i/„(xi,  •),  Xi  G  Di}  satisfies  the 
LDP  continuously  in  xi  with  rate  function  J(xi,  X2).  In  this  research  project  we  have 
shown  that  under  these  conditions,  the  sequence  of  joint  distributions  {fin}  obeys  the 
LDP  with  rate  function/(xi,  X2)  =  /i(xi)  +  J{xi,  X2).  There  are  several  interesting 
applications  of  this  theorem  in  statistics.  For  example,  we  use  our  theorem  to  show  that 
the  joint  distribution  of  the  ordinary  empirical  measure  of  a  sample  and  the  corresponding 
bootstrap  empirical  measure  obeys  the  LDP  in  the  weak  topology.  Other  applications 
include  large  deviations  for  empirical  Bayes  methods  and  random  sums. 
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1.2.2  Invarismt  properties  of  common  statistical  tests. 


The  common  common  statistical  tests  are  derived  under  the  assumption  that  samples 
axe  taJcen  independently  from  one  or  more  normal  populations.  Several  authors  have 
studied  the  ejffect  of  nonnormality  on  these  tests.  Typically,  this  part  of  the  robustness 
hterature  makes  the  assiunption  of  mutual  independence  of  the  observations.  While  the 
independence  assiunption  may  be  approximately  valid  due  to  the  choice  of  experimental 
designs,  clearly  the  case  of  dependence  between  the  observations  is  of  practical  as  well 
as  aesthetic  interest.  One  can  even  argue  that  in  practical  applications,  observations  are 
frequently  not  iid  and  the  physical  systems  responsible  for  generation  of  the  observations 
automatically  introduce  some  dependence  among  the  observations.  It  is  then  clear  that 
the  statistical  interest  should  be  to  determine  if  procedures  valid  under  the  independence 
assumption  continue  to  remain  valid  with  only  a  simple  adjustment  when  independence 
assumption  is  violated. 

In  this  research  project  we  have  obtained  interesting  characterizations  of  covariance 
structures  under  which  the  usual  procedures  remain  vahd  with  possibly  a  scale  factor 
adjustment.  This  was  accomphshed  first  by  obtaining  a  characterization  of  all  nonneg- 
ative  (n.n.d.)  solutions  S  of  a  consistent  matrix  equation  ASA  =  B,  where  A  is  any 
symmetric  matrix  and  B  is  any  n.n.d.~  matrix.  This  result  is  of  independent  interest, 
and  is  useful  in  characterization  problems  concerning  generalized  inverses  of  matrices. 
We  have  used  our  result  to  characterize  the  class  of  covariance  matrices  such  that  the 
distributions  of  several  both  univariate  and  multivariate  test  statistics  remain  invariant. 


1.2.3  Bahadur  efficiency. 


The  most  important  application  of  large  deviation  theory  in  statistics  is  the  calcu¬ 
lation  of  Bahadur  slopes  and  Bahadur  efficiencies.  In  fact  the  notion  of  Bahadur  slope 
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provided  impetus  for  the  development  of  large  deviation  theory.  Both  the  estabhshment 
of  the  LDP  for  a  sequence  of  distributions  and  the  identification  of  the  rate  function  are 
essential  for  explicit  calculations  of  Bahadur  slopes.  We  can  describe  briefly  the  concept 
of  Bahadur  slope  as  follows.  Let  Xi, . . . ,  be  iid  fe{x),  where  6  e  0..  Suppose  we  want 
to  test  the  hypothesis 

H:  e  =  6o  vs  K:  ee  ill. 

Let  r„  =  Tn{Xi, . . . ,  Xn)  be  a  real  valued  test  statistic  with  distribution  FnO  and  consider 
the  test  which  rejects  the  null  hypothesis  H  for  large  values  of  r„.  Given  an  observed 
value  of  Tn  —  tni  the  p- value  or  the  level  of  significance  is  given  by 

Pn  =  Peo(Tn  >  tn)  =  [1  “  FnBoiU)]- 

Motivated  by  this  Bahadur  (1960)  defined  the  level  attained  by  r„  as  the  random  variable 

Ln  =  l-  Fr^eATn). 

Usually,  under  the  null  hypothesis,  L„  is  uniformly  distributed  over  (0,  1)  and  under  the 
alternative  jf/„  — >  0  exponentially  fast.  We  shall  say  that  the  sequence  {T„}  has  exact 
slope  c{6)  if 

—2 

hm  — log  L-n  =  c{0) 

"  n 

almost  surely  under  6.  Note  that  c{6)  determines  the  rate  at  which  ^  0  as  n  — >  co 
and  the  theory  of  large  deviations  is  normally  used  to  determine  c{6).  Now  suppose  that 
we  have  two  test  statistics  Tin  and  72„  with  slopes  Ci{0)  and  C2{0).  If  Ci{6)  >  C2{6)  and 
6  is  the  true  value  then  the  test  based  on  Tin  becomes  significant  sooner  than  the  test 
based  on  T2m  that  is.  Tin  requires  much  smaller  sample  size  to  reject  the  nuU  hypothesis 
then  T2n-  Thus  a  measure  of  asymptotic  relative  efficiency  of  Tin  relative  to  T2n  known 
as  Bahadur  efficiency  is  given  by  the  ratio  Ci{$)/c2{0). 

In  this  research  project  as  an  important  application  of  our  theorem  concerning  LDP 
for  joint  distributions,  we  have  derived  Bahadur  slopes  of  test  statistics  for  the  contam¬ 
inated  normal  model,  which  is  useful  to  study  robustness  of  these  test  statistics.  There 
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are  several  other  potential  applications,  which  include  Bahadur  slopes  for  UMPU  tests 
for  asymmetric  rejection  regions,  and  the  study  of  Bahadur  efficiencies  in  the  presence 
of  nuisance  parameters. 

1.2.4  Redundant  systems. 

The  increasing  need  for  highly  available  and  reliable  computing  systems,  such  as  for 
military,  space,  and  commercial  applications,  the  study  of  methods  to  build  such  systems 
has  become  necessary.  In  general,  high  availability  and  reliability  can  be  achieved  through 
replication  of  components  and/or  systems.  Based  on  the  type  of  redundancy  and  the 
usage  of  the  redvmdant  components,  the  redundant  computing  systems  are  classified  into 
two  major  types 

(1)  Standby  redundant  systems  execute  tasks  only  on  their  active  modules.  Upon  detec¬ 

tion  of  failure  of  an  active  module,  these  systems  attempt  to  replace  the  failed  unit 
with  a  spare.  Thus,  as  in  the  previous  case,  there  is  no  computational  advantage 
due  to  redundancy.  The  system’s  availability,however,  is  increased. 

(2)  Gracefully  degrading  systems  may  use  all  umts  to  execute  tasks,  i.e.,  all  failure-free 
units  are  active.  Hence,  the  redrmdancy  is  also  used  to  obtain  computational  gains 
via  parallelization  of  task  execution.  When  failure  is  detected  in  a  unit,  these 
systems  attempt  to  reconfigure  to  a  system  with  one  fewer  unit. 

These  systems,  both  the  standby  redxmdant  and  the  gracefully  degrading  systems  are 
frequently  employed  to  obtain  high  system  reliability  through  hardware  redundancy.  In 
this  research  project  we  have  studied  performance  analysis  for  gracefully  degrading  sys¬ 
tems  as  well  as  for  standby  redundant  systems  with  special  emphasis  on  the  exponential 
case. 
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